Reliability of genetic networks is evolvable 
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Control of the living cell functions with remarkable reliability despite the stochastic nature of the 
underlying molecular networks — a property presumably optimized by biological evolution. We here 
ask to what extent the property of a stochastic dynamical network to produce reliable dynamics 
is an evolvable trait. Using an evolutionary algorithm based on a deterministic selection criterion 
for the reliability of dynamical attr actors, we evolve dynamical networks of noisy discrete threshold 
nodes. We find that, starting from any random network, reliability of the attractor landscape can 
often be achieved with only few small changes to the network structure. Further, the evolvability of 
networks towards reliable dynamics while retaining their function is investigated and a high success 
rate is found. 
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The processes of life in cells and organisms are largely 
controlled by complex networks of molecular interactions 
as, for example, networks of regulatory genes. A remark- 
able feature of these networks is their reliable function- 
ing, despite their molecular components being subject to 
noise of both, intrinsic as well as extrinsic nature [TJ [2]. 
How does the interplay of such unreliable components 
ensure a reliable functioning of the networks that control 
cells and organisms? 

Naturally, properties of the circuitry can be expected 
to play a major role, and indeed some topological features 
of regulatory networks, such as feedback loops and gene 
redundancy, are known to aid robustness of noisy systems 
[3]. Further studies found numerous evidence for a close 
interplay of topology and robustness of networks [3] [5j [6] . 
What is the origin of such reliable network structures? 

Starting from the fact that real-world biological sys- 
tems are the result of evolutionary processes, noise resis- 
tance of biological networks presumably emerged from 
the interplay of mutation and selection, as well. We 
here study the question of how accessible noise resis- 
tant dynamical networks are to evolution and what the 
costs in terms of topological rearrangements are in or- 
der to achieve a reliable dynamical network. We study 
this question in the framework of numerical experiments, 
evolving discrete dynamical networks in the computer. 

Evolving genetic networks in the computer has a long 
tradition [7J [8j [9]. Several concepts of robustness have 
been studied in this framework, reaching from robustness 
of network dynamics against mutational perturbations 
[8 , to robustness of expression patterns during evolution 
(neutral evolution) [9 , as well as robustness of attractors 
against switching errors of genes [TO] [11] . 

In this paper we extend these viewpoints by study- 
ing the evolution of networks towards robustness against 
small timing fluctuations or "reliability" (to avoid con- 
fusion with existing definitions of robustness). While 
gene switching errors (a type of "perturbation" very com- 
monly used by many authors) are not exactly small per- 



turbations, and may not be the common case in a real 
cell, small perturbations in timing and activity levels are 
ubiquitous in biological systems. Such small noise lev- 
els have recently proven to destroy most attractors in 
Boolean networks that are observed under parallel up- 
date p2J [13] . Obviously, only those attractors that are 
stable against such small noise (i.e., "reliable") can be 
relevant in the biological context. Indeed, in the biolog- 
ical example of the yeast cell cycle network, this type of 
stability against timing perturbations is observed [13] . 

Here, we investigate whether such reliability of a dy- 
namical network can readily result from an evolution- 
ary procedure. Defining biologically motivated mutation- 
selection processes, we will evolve random networks to- 
wards realizations that exhibit reliable dynamics. We 
investigate both the emergence of fully stable attractor 
landscapes as well as the ability of networks to evolve in 
such a way that a given attractor is stabilized. 

We model genes as nodes in a network, where the links 
between two nodes determine the interactions between 
the genes. All bio-molecular processes are simply substi- 
tuted by such a link. The presence of a gene's transcript 
is modeled as a simple on-off switch, the state of which 
is called "activity state". A node can have several in- 
puts and in principle the activity state of a node can 
depend on its inputs through any Boolean rule. As we 
will use an evolutionary process to find robust networks, 
we wish to simplify the rules such that the dynamics is 
fully determined by the network structure alone, with 
no additional freedom of choice in the rules. Thus, we 
choose as a suitable subset of possible Boolean networks 
a threshold network, which amounts to a majority rule in 
the inputs of each node. Every node has a state of either 
1 (active) or —1 (inactive). We allow the links to carry a 
weight of either +1 or —1, corresponding to an activating 
or inhibiting interaction, respectively. The update rule 
in the synchronous case is given by: 

otherwise, W 
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where characterizes the link from node j to node i 
and Si denotes the state of node i. 

As the dynamics is discrete (finite state space) and de- 
terministic, for every initial condition the system reaches 
an attractor, which can be either a fixed point (Si(t+1) = 
Si(t)yi) or a limit cycle, where the same sequence of 
states is repeated indefinitely. 

To assess the stability of a network against fluctuations 
of the signal times, we use the stability criterion of [13] 
which provides a deterministic measure for a network un- 
der investigation. It requires two principle assumptions: 
the nodes implement a low-pass filter that removes the 
effect of activity states that are maintained only over 
short time spans; and the signal time fluctuations are 
small compared to the time scales of the processes and 
that of the filter. 

The first assumption is justified by the buildup and de- 
cay processes of protein concentrations [15] . Gene activ- 
ity states that persist only for a short time do not signif- 
icantly affect other proteins as the gene's transcript can 
only be produced in small numbers. The second assump- 
tion means that we are investigating systems with low 
noise. A single signal fluctuation does not significantly 
perturb the system, but only the addition of many sim- 
ilar perturbations over time can drive the system away 
from an initially synchronous behavior. 

We now give the formal description of the systematic 
stability test: To determine the stability of an attractor, 
first the synchronous state sequence is determined by full 
enumeration of initial states. Choosing one step in an at- 
tractor, we determine all switches that occur at this step 
and call the set of switching nodes M. For every proper, 
non-empty subset S C M we change the switching times 
from t = to t = e, i.e. we retard the switching times 
for these nodes by an infinitesimal number. Thus, a new 
intermediate state from time t = to t = e is created, 
where some nodes have already switched, whereas other 
nodes still exhibit the state of the previous (synchronous) 
time step. We then follow the dynamics, with two times 
for every synchronous time step: 

1. Determine the states at times t = i, i = 1, 2, . . . and 
t' = i + e from the states at t = i — 1 and t' = i — 1 + e, 
respectively. 

2. Apply the filter rule: if a node switches both at 
integer and perturbed time, remove both switches. As 
the activity state has persisted only for a time span of e 
we assume it does not further affect the system. 

3. If all nodes switch at either integer or perturbed 
time, the system has regained synchrony and the attrac- 
tor is stable against this particular subset of perturbed 
nodes. If however, the system reaches a new attractor 
in the combined state space of both times, the system 
is unstable as the perturbation can in general persist in 
the system and might diverge, thus leading to a different 
atttractor or to "chaotic" regime of incessant switchings. 

We call an attractor "stable" if it is stable against 



all subset perturbations, otherwise we call it "unstable" . 
Fixed points are trivially stable by this definition. 

We use an evolutionary algorithm to drive the networks 
to stability. In every step, the network is mutated and 
the result of the stability assessment is compared with the 
mother network. If the mutant fitness is higher than that 
of the original network, the mutant is kept and replaces 
the original, otherwise, a new mutant is tested. This 
is repeated until the requested criterion is fulfilled. As 
different selection criteria are used, the definition of the 
fitness score is given in the respective part of the results 
section. 

Mutation is performed through a single link rewiring, 
which means that at the same time a connection between 
two nodes is removed and a new connection between two 
nodes is added. This procedure amounts to two elemen- 
tary manipulations of the network structure but it has 
the advantage that the average connectivity of the net- 
work is unchanged by the mutation. This allows for bet- 
ter comparison between the random and the evolved net- 
works. As our method requires full enumeration of the 
space of 2^ states where N is the number of nodes, we 
can only perform this analysis for small networks. We 
show the results for N = 16 nodes, but have checked 
that the conclusions also hold for networks with N = 12 
and N = 20 nodes. 

In the first part let us evolve networks towards sta- 
bility regarding the complete attractor landscape. We 
define the evolution process in the following way: given a 
network, we accept a mutation of it, if the mutant has a 
higher number of initial states leading to a stable attrac- 
tor. If so, the network is replaced by the mutant and the 
next evolution step is taken, otherwise a new mutation is 
tested. This procedure stops as soon as all initial states 
lead to stable attractors. 

In figure [I] we show the average number of evolution 
steps necessary to reach full stability of the attractor 
landscape, plotted against the average connectivity, de- 
fined by the total number of edges divided by the number 
of nodes. Networks consist of 16 nodes and 1000 repeti- 
tions were run for every data point. One can see that for 
all connectivities a very small number of mutations al- 
ready suffices to find a completely stable network. Using 
a more restrictive method of selection, like choosing the 
fittest out of several tested mutant networks, further re- 
duces the average evolution steps significantly (data not 
shown) . 

Next, it is interesting to look at network properties 
and how they change during the course of the evolution 
process. In table [I] we compare random networks with 
networks that have undergone the evolution process for 
an average connectivity of (k) = 3 (but the qualitative 
results are typical for any value of (&)). One can see that 
the average number of attractors has decreased and that 
the size of the largest basin has increased at the same 
time. Again, these significant effects take place within 
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FIG. 1: Network evolution rapidly leads to stable attractor 
landscapes: average number of evolution steps vs. average 
connectivity of the networks. The networks consist of 16 
nodes, each data point corresponds to the average of 1000 
runs starting with random networks of the respective connec- 
tivity. 





random networks 


evolved networks 


number of attractors 
largest basin size 
IS to stable atts. 
# of evolution steps 


3.98 ±0.02 
47800 ± 100 
40300 ± 200 


2.12 ±0.01 
57100 ± 100 
65536 
2.07 ±0.02 



TABLE I: Comparison of attractor basin characteristics of 
random and evolved networks for N=16, (k) = 3. Averages 
over 20000 runs. 



very few evolution steps. Thus, we find that the dynami- 
cal landscape of a threshold network can be significantly 
altered by only a few mutations of the network topology. 
Stability of the attractor landscape can be achieved with- 
out significant changes of the overall network structure. 

To ensure that we do not simply observe the effects of 
networks evolving towards fixed points (which are always 
stable), we have checked all results also with the rule that 
a fixed point is counted as an unstable attractor. We do 
not show the results here, but the general results and the 
conclusions drawn above hold also in this case. 

These results clearly show that in our simple dynamical 
model, random networks exhibit an astonishing evolv- 
ability regarding their attractor landscapes. The land- 
scape can be easily shaped and robustness in dynami- 
cal functioning can be achieved after very few evolution 
steps. 

So far we have demonstrated that random networks 
can be quickly evolved towards a completely stable at- 
tractor landscape. However, we have not constrained the 
dynamics in any way, so the evolved networks might show 
completely different dynamical behavior than the original 
networks. If we think of attractors as a function being 
performed by a genetic network, we should restrict evo- 
lution to those networks that are able to reproduce the 
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FIG. 2: Functional attractor stabilization. The ratio of net- 
works successfully stabilized in the evolution is plotted against 
average connectivity. Network size N = 16, every data point 
amounts to the average of 1000 runs at the respective con- 
nectivity. Upper points (x): neutral mutations (see text). 
Lower points (+): single link rewirings. Many networks can 
be stabilized, with neutral mutations practically all networks 
with connectivities larger than 2. 



original attractor dynamics. 

This leads to a modified selection criterion with the 
following target: We choose the largest attractor of the 
original network as the "functional attractor" and require 
stabilization of this attractor. If it is a fixed point or a 
stable limit cycle, there is trivially nothing to do in the 
evolution, so we just discard these networks and create a 
new one until we find a network with an unstable largest 
attractor. During evolution, every mutant has to repro- 
duce this attractor. This means that, starting at one 
step of the attractor cycle, the dynamics of the original 
network and of the mutant have to be exactly the same. 
If the mutant does not reproduce the attractor, it is im- 
mediately discarded. We do not request the networks to 
reproduce the transient states as this constraint is too 
strict and disallows practically every mutation. 

The fitness score is given by the multiplication of the 
stability value (0 if unstable, 1 if stable) with the basin 
size of the functional attractor. We have employed two 
different selection criteria: strict or neutral selection. In 
the strict selection scheme, a network is only accepted, if 
it increases the fitness score, whereas in the neutral se- 
lection a larger or equal fitness score suffices. This means 
that in the strict scheme, the stabilization has to occur 
within a single rewiring, whereas the neutral criterion al- 
lows for a random walk through the space of networks 
that exhibit the functional attractor. The evolution pro- 
cess is complete as soon as the functional attractor is sta- 
ble with a basin size of half the total state space, which 
makes the functional attractor the dominant dynamical 
expression pattern. 

In figure [2] we show the results of the evolution pro- 
cesses using the functional attractor criterion for a net- 
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work size of N = 16 and 1000 attempted evolution runs. 
The ratio of networks that can be stabilized in both selec- 
tion schemes is plotted against the average connectivity 
of the networks. For each evolution step, we have at- 
tempted 20000 mutations before marking a network as 
not evolvable towards stability (this arbitrary criterion 
does not influence the results as long as the number of 
attempts is sufficiently high). In the neutral selection, 
a stable network has to be found within 10 6 mutation 
attempts during the full evolution run. 

First, one can see that even in the single-step evolution 
(marked by a cross x), more than half of all networks 
can be stabilized. For very low connectivity as well as 
connectivities above 3, more than 3/4 of all networks 
fulfill the criterion. The dip at connectivities around 1.5 
can be attributed to the fact that network dynamics start 
to become complex, but the possibility of affecting the 
stability without destroying the attractor are small. At 
higher connectivities, the degeneracy of the topology aids 
the stabilization of the system, at small connectivities, 
self-couplings can often create a stable dynamical core 
which drives all other nodes like a central clock. 

Next, we investigate the effect of the neutral selection. 
The chance of finding a network with stabilized func- 
tional attractor is significantly increased as compared to 
the single-step stabilization. Especially for networks of 
connectivities around 1.5, the additional number of stabi- 
lized networks is high. For connectivities above 2, practi- 
cally every network can be stabilized using this evolution 
process. 

In figure [3] we show a typical example of an evolution- 
ary process for a network with 12 nodes and (k) — 2 (cre- 
ated with DDLAB [16]). The network structure as well 
as the full synchronous attractor landscape is shown, be- 
fore (top) and after a single mutation (bottom). In the 
attractor landscape figure, each network state is repre- 
sented by a dot that is connected to the concurrent state 
by a line. The central shape denotes the limit cycle (or 
fixed point). All four attractors of the original network 
are unstable. After mutation (mutated links are depicted 
by thick lines), only two attractors remain. The func- 
tional attractor with a cycle length of four is now stable. 
One can see how the single mutation dramatically affects 
the attractor landscape of the network. 

Two implications of our results are at hand. First, we 
find that the topological features of a network do not 
strictly constrain the stability of the resulting network 
dynamics. Small changes in the rewiring can have dra- 
matic effects on the attractor landscape, including com- 
plete stabilization. Second, the (synchronous) state se- 
quence of an attractor does not determine the stability. 
Even within small topological changes, it is often pos- 
sible to find networks which exhibit the same attractor, 
but perform it in a reliable way. 




FIG. 3: A single rewiring can dramatically affect the attractor 
landscape. The network structure and attractor landscape 
(state space visualization) of a network before (top) and after 
(bottom) a single rewiring. Central shape in the attractor 
pictures show limit cycle, transient states are arranged on 
arcs. 
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